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(57) In an innage processing apparatus which has 
an operating system (102) and scanner driver (103), is 
connected to a scanner (1 04) for reading an original and 
converting it into an inrtage signal, and stores infiage data 
read by manipulating the scanner (104), a forgery de- 
termination processing module (1 03-2) of the scanner 
driver (1 03) compares the read digital watemnark data 
with specific image data to detennine the matching de- 
gree, and an anti-forgery control module (106) controls 
predetemilned image processing on the basis of the de- 
tenminatlon result for the image data read by the scanner 
driver (103). 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates to an infornnation 5 
processing apparatus in which an operating system can 
control read operation of an original image by a scanner 
via a scanner driver, or an infomriatlon processing appa- 
ratus in which an operating system can control printing 
operation of image data by a printer via a printer driver, io 
and a processing method therefor. 

BACKGROUND OF THE INVENTION 

[0002] In recent years, color image reading appara- 
tuses (to be refen^ed to as color scanners hereinafter) 
using CCDs or the like as photoelectric conversion ele- 
ments, and color printers have been improved in per- 
fomnance. This increases the risk of copying and forging 
copying-prohibited originals such as bank notes or se- 20 
curities by reading copying-prohibited originals such as 
bank notes or securities as image data by a color image 
reading apparatus and outputting them to a color printer 
To prevent the forgery, a color copying machine as a 
combination of a color scanner and color printer often 25 
incorporates an anti-forgery apparatus whrch detects a 
copying-prohibited original to prohibit Its copying. 
[0003] In addition, a so-called digital watemiaric tech- 
nique of embedding infornnation in an Image so as not 
to recognize It with a naked eye is put into practice. 30 
[0004] However, an anti-forgery apparatus used in a 
color copying machine operates only in copying opera- 
tion. If a copylng<prohiblted original is independently 
read once by a color scanner, the image of the copying- 
prohibited original can undesirably be output by the 35 
color copying machine or another color printer via a con- 
troller. Forgery processing by a system, e.g., scanner 
system or information processing apparatus capable of 
outputting image data to the color printer via a host com- 
puter cannot be effectively limited between the color 40 
scanner and the color printer A serious problem of eas- 
ily forging copying-prohibited originals arises. 
[0005] Furthemiore, there is no infornnation process- 
ing apparatus for outputting embedded Infomiatlon so 
as to easily recognize it. 45 
[0006] The present invention has been made to ad- 
dress one or more of the conventional drawbacks. An 
embodiment provides an infomiatlon processing appa- 
ratus capable of allowing an operating system to control 
read operation of an original image by a scanner via a so 
scanner driver, wherein image data read by the scanner 
driver is compared with specific image data to detemnine 
the matching degree, predetemnined image processing 
for the image data read by the scanner driver is control- 
led on the basis of the detennlnation result, and thus ss 
even in an environment in which the scanner is not con- 
stituted as a copying system integrated with a printer 
and can perfonn image read processing by the scanner 



itseif , when image data which matches a specific image 
whose copying operation is prohibited is read, the read 
illicit image data which matches the specific Image Is 
processed into insignificant image data, thereby reliably 
preventing image input processing of creating a forgery 
from a copying-prohibited original. An embodiment pro- 
vides an infomiation processing apparatus capable of 
allowing an operating system to control printing opera- 
tion of image data by a printer via a printer driver, where- 
in image data rasterized by the printer driver is com- 
pared with specific Image data to detennlne the match- 
ing degree, predetemriined image processing for the im- 
age data rasterized by the printer driver is controlled on 
the basis of the detemni nation result, and thus even In 
an environment in which the printer is not constituted as 
a copying system integrated with a scanner and can per- 
form image output processing by the printer itself, when 
image data which matches a specific image whose cop- 
ying operation is prohibited is rasterized, the rasterized 
illicit image data which matches the specific image is 
processed into insignificant image data, thereby reliably 
preventing Image output processing of creating a for- 
gery from a copying-prohibited original. Embodiments 
also provide processing methods therefor 
[0007] A further object is to provide an information 
processing apparatus capable of extracting infonmation 
embedded in an image, processing the extracted infor- 
mation into an Image, and outputting the Image, and a 
processing method therefor 

[0008] In an embodiment, an information processing 
apparatus capable of controlling read operation of an 
original image by a scanner (scanner 104 shown in Fig. 
2) via a scanner driver (corresponding to a scanner driv- 
er 103 shown in Fig. 2) comprises determination means 
(corresponding to a forgery detenni nation processing 
module 103-2 shown in Fig. 2) for determining by the 
scanner driver whether digital watemiaric infomiatlon is 
embedded in image data read by the scanner, and con- 
trol means (con-esponding to an anti-forgery control 
module 106 shown in Fig. 2) for controlling predeter- 
mined image processing for the read data on the basis 
of a detenmination result by the determination means. 
[0009] The control means may process the read Im* 
age data into image data different from the read Image 
data when the detemnination means detemnines that the 
image data substantially matches the specific Image da- 
ta. 

[0010] Display means (monitor 109 shown in Fig. 2) 
may be provided for displaying a waming message rep- 
resenting that the image data is processed to match the 
specific image data when the control means perfonns 
the predetemnined image processing for the image data, 
and the control means may discard the read and proc- 
essed image data on the basis of an image processing 
request from a user in response to the warning message 
displayed on the display means. 
[001 1 ] The predetermined image processing may in- 
clude resolution conversion processing of converting a 
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resolution of the read image data, color conversion 
processing of converting color tone of the read image 
data, and Image conversion processing of adding arbi- 
trary Image data to the read image data. 
[0012] The control means may create log information 
from which a read processing status of the specific im- 
age data can be verified, and may register the log infor- 
mation in a nonvolatile memory on the basis of the Im- 
age processing request from the user in response to the 
waming message displayed on the display means. 
[0013] The specific image data may Include an origi- 
nal image whose copying operation is prohibited by law. 
[0014] The specific Image data may be stored and 
managed in advance so as to be updateable. 
[0015] The scanner can be connected via a local in* 
terface or a network interface. 
[0016] The digital watermark information may be em- 
bedded in the specific image data at a predetennined 
cycle. 

[0017] The digital watermark infomnation may include, 
as code information, infonnation about the type of spe* 
clfic image data, an issue country, an Issue number, and 
a value. 

[0018] The digital watermark information may Include 
invisible or visible infomnation. 
[001 9] Storage means may be provided for storing Im- 
age data read by the scanner, and the control means 
may also process an image stored in the storage means. 
[0020] In an embodiment, an image processing meth- 
od for an Information processing apparatus capable of 
controlling read operation of an original image by a 
scanner (scanner 104 shown in Fig. 2) via a scanner 
driver (corresponding to the scanner driver 1 03 shown 
in Fig. 2) comprises the determination step of detennin- 
ing by the scanner driver whether digital watermark in- 
fomnation is embedded in image data read by the scan- 
ner, and the control step of controlling predetemnlned 
image processing for the read image data on the basis 
of a determination result in the detemriination step. 
[0021] The control step (step S601 shown in Fig. 8) 
may comprise processing the read image data into Im- 
age data different from the read image data when the 
Image data is determined in the detennination step to 
substantially match the specific image data. 
[0022] A display step (step S602 shown in Fig. 8) may 
be provided of displaying a warning message represent- 
ing that the image data is processed to match the spe- 
cific image data when the predetermined image 
processing is performed for the image data in the control 
step, and the control step may comprise discarding 
(step S604 shown in Fig. 8) the read and processed Im- 
age data on the basis of an Image processing request 
from a user in response to the waming message dis- 
played in the display step. * 
[0023] The predetermined image processing may in- 
clude resolution conversion processing of converting a 
resolution of the read Image data, color conversion 
processing of converting color tone of the read image 



data, and image conversion processing of adding arbi- 
trary image data to the read image data. 
[0024] The control step may comprise creating log in- 
fonmation from which a read processing status of the 

5 specific image data can be verified, and registering the 
log information In a nonvolatile memory (corresponding 
to a hard disk 1 08 shown in Fig. 2) on the basis of the 
image processing request from the user in response to 
the warning message displayed in the display step. 

10 [0025] An embodiment of the invention also provides 
a recording medium storing in a computer-readable 
manner a program for causing an infomriatlon process- 
ing apparatus capable of controlling read operation of 
an original image by a scanner (scanner 104 shown in 

15 Fig. 2) via a scanner driver (corresponding to the scan- 
ner driver 1 03 shown in Fig. 2), to execute the determi- 
nation step of detemnining by the scanner driver whether 
digital watermark infomnation Is embedded in Image da- 
ta read by the scanner, and the control step of controlling 

20 predetermined image processing for the read Image da- 
ta on the basis of a detennination result in the detemrii- 
nation step. 

[0026] The program may define the control step (step 
S601 shown in Fig. 8) to comprise processing the read 
25 image data into image data different from the read im- 
age data when the image data is determined in the de- 
temnination step to substantially match the specific im- 
age data. 

[0027] The program may include a program for caus- 

30 ing the Information processing apparatus to execute the 
display step (step S602 shown in Fig. 8) of displaying a 
waming message representing that the image data is 
processed to match the specific Image data when the 
predetennined image processing Is performed for the 

35 image data In the control step, and the control step com- 
prises discarding (step S604 shown in Fig. 8) the read 
and processed image data on the basis of an image 
processing request from a user in response to the wam- 
ing message displayed in the display step. 

40 [0028] The program may define the predetennined 
image processing to include resolution conversion 
processing of converting a resolution of the read Image 
data, color conversion processing of converting color 
tone of the read image data, and image conversion 

45 processing of adding arbitrary Image data to the read 
Image data. 

[0029] The program may define the control step to 
comprise creating log infomiation from which a read 
processing status of the specific image data can be ver- 

so if led, and registering the log Infonnation in a nonvolatile 
memory (corresponding to the hard disk 108 shown in 
Fig. 2) on the basis of the Image processing request 
from the user with respect to the warning message dis- 
played in the display step. 

55 [0030] An embodiment of the invention also provides 
an infomnation processing apparatus capable of control- 
ling read operation of an original image by a scanner 
(scanner 1 04 shown in Fig. 1 5) via a scanner driver (cor- 
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responding to the scanner driver 103 shown in Fig. 15) 
comprising Infomnation extraction means (correspond- 
ing to a digital watermark extraction module 103-3 
shown In Fig. 15) for extracting, by the scanner driver, 
digital watennarl< information embedded in image data 5 
read by the scanner, and image processing means (cor- 
responding to an image processing control module 116 
shown In Fig. 15) for processing the image data on the 
basis of an extraction result from said information ex- 
traction means. io 
[0031] Selection means (corresponding to a monitor 
1 09 shown in Fig. 15) may also be provided for causing 
a user to select whether to process the Image data by 
the image processing means. 
[0032] The selection means may display whether to 
process the image data on display means, thereby 
causing the user to select whether to process the Image 
data. 

[0033] The image processing means may overlay the 
information extracted by the information extraction 20 
means on the image data. 

[0034] An embodiment of the invention also provides 
a processing method for an infomnation processing ap- 
paratus capable of controlling read operation of an orig- 
inal image by a scanner via a scanner driver comprises 25 
an Information extraction step (step S423 shown in Fig. 
16) of extracting, by the scanner driver, digital water- 
mark infonnation embedded in image data read by the 
scanner, and an image processing step (step S413 
shown in Fig. 1 6) of processing the image data on the ^ 
basis of an extraction result in the information extraction 
step. 

[0035] An embodiment of the invention also provides 
a recording medium storing in a computer-readable 
manner a program for causing an infomnation process- 35 
ing apparatus capable of controlling read operation of 
an original Image by a scanner via a scanner driver, to 
execute an information extraction step of extracting, by 
the scanner driver, digital watermart< Information em- 
bedded in image data read by the scanner, and an im- 40 
age processing step of processing the input image data 
on the basis of an extraction result. 
[0036] Other features and advantages of embodi- 
ments will be apparent from the following description 
taken in conjunction with the accompanying drawings, 45 
in which like reference characters designate the same 
or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

50 

[0037] 

Fig. 1 is a block diagram showing an example of an 
Image processing system to which an infomnation 
processing apparatus according to the first embod- ss 
iment of the present invention can be applied; 
Fig. 2 is a block diagram for explaining the internal 
structure of the OS in the host computer 21 shown 



in Fig. 1; 

Fig. 3 is a flow chart showing an example of the first 
data processing sequence in the information 
processing apparatus according to the present In- 
vention; 

Figs. 4A and 4B are views showing an example of 
anti-forgery processing by an operating system 
shown in Fig. 2; 

Fig. 5 Is a graph showing an example of image data 
processing by the operating system shown In Fig. 2; 
Fig. 6 is a view showing an example of a user Inter- 
face window displayed on a monitor shown in Fig. 2; 
Fig. 7 is a view showing an example of log infomia- 
tion stored in a hard disk shown in Fig. 2; 
Fig. 8 is a flow chart showing an example of the sec- 
ond data processing sequence in the infomnation 
processing apparatus according to the present In- 
vention; 

Fig. 9 is a block diagram showing an example of an 
information processing apparatus according to the 
second embodiment of the present Invention; 
Fig. 10 is a graph showing an image processing 
principle for image data to be forged in the infomna- 
tion processing apparatus according to the present 
invention; 

Fig. 11 Is a view showing an example of Image 
processing in an infomnation processing apparatus 
according to the third embodiment of the present 

invention; 

Fig. 1 2 is a view showing another example of image 
processing In the Infomnation processing apparatus 
according to the third embodiment of the present 
invention; 

Fig. 13 is a view showing still another example of 
image processing in the infomnation processing ap- 
paratus according to the third embodiment of the 
present invention; 

Fig. 14 is a view for explaining the memory map of 
a storage medium which stores various data 
processing programs readable by the information 
processing apparatus according to the present in- 
vention; 

Fig. 1 5 is a block diagram showing the an-angement 
of an image processing system in the fourth embod- 
iment; 

Fig. 16 is a flow chart showing the processing se- 
quence of the system in the fourth embodiment; 
Fig. 17 is a view showing an example of a user In- 
terface window displayed on a monitor 109; 
Figs. ISA and 188 are views showing an example 
of image processing according to the fourth embod- 
iment; 

Fig. 19 is a view showing an example of log infor- 
mation stored in a hard disk 108; 
Fig. 20 is a block diagram showing the an-angement 
of an image processing system In the fifth embodi- 
ment; 

Fig. 21 is a flow chart showing the processing se- 
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quence of the system in the fifth embodiment; and 
Fig. 22 is a view for explaining the memory map of 
a storage medium which stores various data 
processing programs readable by the information 
processing apparatus according to the present in- 
vention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[First Embodiment] 

[0038] Fig. 1 is a blocl< diagram showing an example 
of an Image processing system to which an infonnation 
processing apparatus according to the first embodiment 
of the present invention can be applied. As shown in Fig. 
1 , this system is built by a printer 23 and scanner 22, 
including a host computer (infonnation processing ap- 
paratus) 21 . This system may be built as a scanner sys- 
tem by the host computer 21 and scanner 22, or as a 
printer system by the host computer 21 and printer 23. 
Alternatively, the system may be built by only either of 
the systems. The system may use a plurality of scanners 
or printers. The present invention can be applied to any 
connection fonn regardless of a networl< or local con- 
nection. 

[0039] An operating system (to be refen'ed to as an 
"OS" hereinafter) 1 02 shown in Fig. 2 runs on the host 
computer 21. A scanner manipulation application (ap- 
plication) 101 running on the OS provides a manipula- 
tion environment for, e.g., image read operation of a 
scanner 104 (corresponding to the scanner 22 shown in 
Flg.1). 

[0040] In Fig. 1, the host computer 21 as a scanner 
system comprises a monitor 201 for displaying the GUI 
of the application 1 01 or an image read result from the 
scanner 22, a mouse 202 for transferring a user input to 
the application and OS, a keyboard 203, an HDD 208 
for storing various programs and image data, a ROM 
206 for storing the basic programs of the host computer 

21 , a RAM 205 for reading a program and storing an 
image, and a scanner l/F 207 for controlling the scanner 

22. The monitor 201 , mouse 202, keyboard 203, HDD 
208, ROM 206, RAM 205. and scanner l/F 207 are con- 
nected to each other via an internal bus 209, and con- 
trolled by a CPU 204. 

[0041] The host computer21 as a printersystem com- 
prises the monitor 201 for displaying the GUI of an ap- 
plication 701 (to be described later) shown in Fig. 9 or 
an image to be output to the printer 23, the mouse 202 
fortransfemng a user input to the application and OS, 
the keyboard 203, the HDD 208 for storing various pro- 
grams and image data, the ROM 206 for storing the ba- 
sic programs of the host computer 21 , the RAM 205 for 
loading a program and storing an image, and a printer 
l/F 210 for controlling the printer 23. The monitor 201 , 
mouse 202, keyboard 203, HDD 208, ROM 206, RAM 
205, and printer l/F 21 0 are connected to each other via 



8 

the internal bus 209, and controlled by the CPU 204. 
[0042] Both the OS and application are realized on the 
host computer 21 having this arrangement by running 
by the CPU 204 a program loaded from the HDD 208 to 
5 the RAM 205. 

[0043] The intemal structure of the OS will be ex- 
plained within a range necessary for this system. 
[0044] Fig. 2 is a block diagram for explaining the in- 
ternal structure of the OS in the host computer 21 shown 
in Fig. 1 . Note that most of OSs such as UNIX isolatedly 
mount a device driver which interfaces with hardware 
such as a scanner, and various modules for perfonning 
management of other user applications, memory man- 
agement, and the like. In this embodiment, an OS hav- 
ing this isolation structure will be exemplified. In Fig. 2, 
the OS 102 has a scanner driver 103 as a module for 
controlling a user input and another hardware device, 
and in addition controlling the scanner 1 04. The scanner 
driver 1 03 in the first embodiment comprises a scanner 
control module 1 03-1 for directly controlling the scanner 
104 and a forgery detennination processing module 
103-2 for determining whether an image received from 
the scanner 104 is an copying- prohibited original. 
[0045] The OS 1 02 has a memory management mod- 
ule 1 05 for managing the image data area of an image 
memory 1 1 0 which stores image data received from the 
scanner 1 04. The image memory 1 1 0 is part of the RAM 
205 shown in Fig. 1 . 

[0046] The application 101 is made up of a GUI rou- 
tine for interfacing with the user, a routine for interpreting 
a user input received via the OS 1 02 and issuing an in- 
struction for operating the scanner 1 04, a routine for dis- 
playing image data read from the scanner 104, and a 
routine for saving read image data in an HDD 108. 
[0047] The scanner 104 scans an original placed on 
a table with a CCD line sensor (not shown) in accord- 
ance with a scanner manipulation signal from the scan- 
ner driver 1 03 to optically read the original, converts the 
image data into an electrical signal (photoelectric con- 
version), and retums the image signal to the host com- 
puter 21 (more specifically, the scanner control module 
103-1 of the scanner driver 103) in accordance with a 
predetennined interface rule. 

[0048] The image signal is comprised of a plurality of 
color components, e.g., R, G, and B, and each color 
component is multilevel data of 8 to 12 bits. 
[0049] The data processing sequence of the scanner 
system shown in Fig. 2 will be explained on the basis of 
a flow chart shown in Fig. 3. 

[0050] Fig. 3 is a flow chart showing an example of 
the first data processing sequence in the infomriation 
processing apparatus according to the present inven- 
tion. This data processing sequence corresponds to a 
data processing sequence between the modules of the 
application 1 01 , OS 1 02, and scanner driver 103 shown 
in Fig. 2. S301 to S303 shown in Fig. 3 correspond to 
the steps of the application 101; S311 to S315, to the 
steps of the operating system 102; and S321 to S324. 
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to the steps of the scanner driver 1 03. 
[0051] When the user instructs scanning start opera- 
tion via the GUI of the application 101 , the application 
101 advances to step S301. Before read operation 
starts, the application 1 01 ensures in the image memory 5 
110 (f^M 205) the area of an image to be read that is 
designated by the user. Note that the image area on the 
Image memory 110 is ensured by the memory manage- 
ment module 105. In step S302, the application 101 
specifies the scanner 104 to be used to the OS 1 02, Is- 
sues an Image read Instruction, and enters a wait state 
and stays there until the application 1 01 receives an Im- 
age read processing end notification In step S303. 
[0052] The OS 1 02 which has received the scanning 
start instruction shifts to step S311, and Invokes the 
scanner driver 103 corresponding to the specified scan- 
ner (in the first embodiment, the local-connected scan- 
ner 104) to issue an image read Instruction to the scan- 
ner driver 1 03. The OS 1 02 enters a wait state and stays 
there until the OS 1 02 receives a processing end notifi- 
cation from the scanner driver 1 03 In step S31 2. At this 
time, the OS 1 02 prepares as a variable a determination 
ratio representing whether image data is a copying-pro- 
hibited original so that the forgery determination 
processing module 103-2 detennlnes the determination 
ratio. 

[0053] The scanner control module 1 03-1 in the scan- 
ner driver 103 that has received the Image read start 
instruction from the OS 1 02 advances to step S321 , and 
issues a scanning start instruction unique to the scanner 
to the scanner 104 to start Image read by the scanner 
1 04. In step S322, the scanner control module 1 03-1 
receives an Image signal of an original image read by 
the scanner 1 04, stores the image signal in the image 
area In the image memory 110 (RAM 205) ensured by 
the application 1 01 , and shifts processing to the forgery 
detemnination processing module 1 03-2 In the scanner 
driver 1 03. 

[0054] Note that the forgery determination processing 
module 103-2 has a copying-prohibited pattern as a 
template in a memory (RAM or ROM) arranged sepa- 
rately from the image memory 110. 
[0055] In step S323, the forgery determination 
processing module 103-2 executes pattern matching 
between the template and the Image data stored in the 
Image memory 110 (RAM 205), and outputs the match- 
ing result as a detemiination ratio having a value from 
"0" to "1 00". As an example of this pattem matching, the 
correlation between the image data and the template is 
calculated for each color component to output a maxi- 
mum value. However, the pattern matching method in 
the first embodiment is not particularly limited. 
[0056] A plurality of copying-prohibited pattern tem- 
plates may be prepared. In this case, the forgery deter- 
mination processing module 103-2 performs pattern 
matching between a plurality of patterns and image da- 
ta, and outputs a maximum value. 
[0057] The first embodiment has described the for- 



gery detemiination processing module 103-2 as a soft- 
ware module. However, the forgery detemiination 
processing module 103-2 is not limited to this, and can 
be realized as hardware processing constituted by, e.g., 
a high-speed RISC and ASIC to increase the speed. 
[0058] After the image data is read and subjected to 
forgery detemiination processing, the scanner driver 
103 notifies in step S324the OS 102 of the end of read 
processing, and at the same time returns the determi- 
nation ratio as a result of pattern matching with the cop- 
ying-prohibited pattem. 

[0059] If the OS 1 02 receives the processing end no- 
tification from the scanner driver 103 In step S312, the 
OS 1 02 shifts to step S313, and checks whether the im- 
age data is a copying-prohibited image, on the basis of 
the result (detemiination ratio) of actually perfomning 
forgery detemiination processing by the forgery deter- 
mination processing module 103-2. If the detemiination 
ratio is higher than a threshold set in advance on the OS 
102 side, the OS 102 determines that the image data 
read by the scanner 104 may be a copying-prohibited 
image at a high possibility. Then, the OS 1 02 advances 
to step S314 to perform anti-forgery control processing 
(to be described in later). 

[0060] If the detemiination ratio Is determined in step 
S313 to be lower than the pre-set threshold, or anti-for- 
gery control processing ends, the OS 1 02 shifts to step 
S315, and issues a processing end notification to the 
application 101 to end Image read operation of the scan- 
ner system. 

[0061] Figs. 4A and 4B are views showing an example 
of anti-forgery processing by the operating system 102 
shown in Fig. 2, and corresponds to an anti-forgery 
processing state to a bank note whose copying opera- 
tion is prohibited. Fig. 4A represents an original image 
read by the scanner 1 04, and Fig. 48 represents a proc- 
essed Image. 

[0062] Fig. 5 is a graph showing an example of image 
data processing by the operating system 102 shown in 
Fig. 2. The ordinate represents image data (Green), and 
the abscissa represents the scanning position. I in Fig. 
5 indk;ates original image data, and II indicates proc- 
essed image data. 

[0063] Fig. 5 shows Green data at part of an image 
along the ordinate, and the main scanning position of 
the image along the abscissa. The ordinate represents 
that image data has 256 gray levels from "0" to "255". 
As image data is nearer "255", the image is bright. Im- 
age data I means original Image data before processing. 
By setti ng image data to a smaller value by a given value 
for all the pixels of the image data, image data II is gen- 
erated. Of image data II, all data of "0" or less are "0", 
so that tonal infomiation of the image is lost. This 
processing is executed for Red and Blue except Green 
to generate Image Fig. 4B as an output image candi- 
date. 

[0064] The first embodiment cannot return a proc- 
essed Image to an image before processing. From this, 
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an image displayed on a monitor 1 09 by tlie application 
101 and an image saved In an HDD 108 are all proc- 
essed Innages. 

[0065] Fig. 6 is a view showing an example of a user 

interface window displayed on the monitor 109 shown 5 
in Fig. 2, and corresponds to a warning window example 
displayed to the user when image data read by the scan- 
ner 104 is detected as copying-prohibited image data. 
In Fig. 6, BT1 is a button which is selected and clicked 
by the user when the user approves the contents of a 
displayed warning and outputs an image. BT2 Is a but- 
ton which is selected and clicked by the user when the 
user approves the contents of a displayed warning and 
avoids outputting an Image. 

[0066] Fig. 7 is a view showing an example of log in- 
formation stored in the hard disk 1 08 shown in Fig. 2. 
This log information corresponds to a manipulation log 
of the scanner 104. In Fig. 7, the manipulation log in- 
cludes the time, host computer infonmation (manufac- 
turer name, host ID, and OS version), image size, and 
detemiinatlon ratio. 

[0067] Anti-forgery control processing (3314) shown 
In Fig. 3 will be described in detail with reference to a 
flow chart shown In Fig. 8. 

[0068] Fig. 8 is a flow chart showing an example of 
the second data processing sequence in the Infonmation 
processing apparatus according to the present inven- 
tion, and corresponds to the anti-forgery control 
processing sequence in step S31 4 shown in Fig. 3. Note 
that reference symbols S600 to S605 denote steps. 
[0069] Processing starts in step S600, and an Image 
in the image memory 1 1 0 undergoes anti-forgery image 
processing in step S601 . 

[0070] In the first embodiment, original image Fig. 4A 
undergoes processing to generate an image painted out 
with gray as processed image Fig. 4B. More specifically, 
as shown in Fig. 5, the processing principle is to perfomfi 
image processing for original image data I and generate 
image data II. 

[0071] Assuming that image data I is comprised of R 
(Red), G (Green), and B (Blue) color signals, the user 
input window shown in Fig. 6 is displayed on the monitor 
109 via a display driver 107. Accordingly, when an im- 
age input by the scanner 1 04 may be a copying-prohib- 
ited original, the user is made to confinn whether to ac- 
tually read the image. 

[0072] In step S603, it is checked whether either of 
the buttons on the user input window, i.e., "OK", con'e- 
sponding to the button BT1 and "Cancel" con-esponding 
to the button BT2 has been selected and clicked. If "OK" 
has been selected and clicked (if the image is to be 
read), a manipulation log as shown in Fig. 7 is stored in 
the HDD 108, and processing ends in step S605. The 
operation that the copying-prohibited original has been 
read can be left as an evidence, which facilitates con- 
firming whether the copying-prohibited original has 
been input. 

[0073] If "Cancel" is detemnined In step S603 to be 



selected and clicked, that is, the image is not to be read, 
the image memory 110 storing the image is freed, no 
Image read is perfomned, and processing ends in step 
S605. 

[0074] As described above, according to the first em- 
bodiment, the information processing apparatus, which 
can control read operation of an original Image by the 
scanner via the scanner driver by the operating system, 
compares image data read by the scanner driver with 
specific image data to detemriine the matching degree, 
controls predetemilned Image processing for the image 
data read by the scanner driver on the basis of the de- 
termination result, and thus even in an environment 
which can perform image read processing by the scan- 
ner itself (not use a printer), when image data which 
matches a specific image whose copying operation is 
prohibited is read, processes the read illicit image data 
which matches the specific image into insignificant im- 
age data, thereby reliably preventing image input 
processing of creating a forgery from a copying-prohib- 
ited original. 

[Second Embodiment] 

[0075] The first embodiment has described a case 
wherein predetennined image processing is executed 
in a scanner system for an Input image of an anti-forgery 
target original. The present Invention is not limited to 
this, and anti-forgery processing can be done in, e.g., a 
printer system as well. This embodiment will be ex- 
plained. 

[0076] Fig. 9 Is a block diagram showing an example 
of an infomnatlon processing apparatus according to the 
second embodiment of the present Invention. According 
to the second embodiment, anti-forgery processing is 
perfomried by a printer driver 703 and OS 702 shown in 
Fig. 9 in an image processing system built by a host 
computer 21 and printer 23 shown in Fig. 1. Similar to 
the first embodiment, the OS 702 mns on the host com- 
puter 21 , and an application 701 running on the OS 702 
provides a manipulation environment for image output 
operation to a printer 704 (con-esponding to the printer 
23 shown in Fig. 1). 

[0077] Similar to the scanner system shown in Fig. 2, 
the printer system shown in Fig. 9 Is also Implemented 
on a hardware arrangement shown in Fig. 1. This sys- 
tem is built by the host computer 21 and printer 23 (print- 
er 704 in Fig. 9). Both the OS and application on the 
host computer 21 realize anti-forgery processing in the 
printer system by running by a CPU 204 a program load- 
ed from an HDD 208 to a RAM 205. In Fig. 9, the OS 
702 has a printer driver 703 as a module for controlling 
a user Input and another hardware device, and in addi- 
tion controlling the printer. The printer driver 703 com- 
prises a rasterizer 703-1 for generating image data suit- 
able for the printer 704, a memory management module 
703-2 for managing an image memory 710 for storing 
the generated image data, and a forgery detemiinatlon 
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processing module 703-3 for determining whether the 
rasterized image is a copying-prohibited original. 
[0078] A forgery determination result output from the 
forgery detemilnation processing module 703-3 Is trans- 
ferred to an anti-forgery control module 705 which per- s 
forms processing for preventing or suppressing forgery 
operation on the basis of the determination result. 
[0079] The OS 702 has a printing spooler 709 for per- 
fonning control for outputting an Image rasterized by the 
rasterizer 703-1 In the printer driver 703 to the printer 
704. In this embodiment, the rasterizer 703-1 and for- 
gery determination processing module 703-3 are oper- 
ated by the printer driver 703, i.e. , by software process- 
ing, but can be operated on the printer 704 side. 
[0080] In this case, the result of forgery detemninatlon 
processing perfomied on the printer 704 side Is retumed 
to the anti-forgery control module 705. The flow of anti- 
forgery processing in the second embodiment will be ex- 
plained. 

[0081] When the OS 702 which has received a print- 
ing instniction command via the GUI of the application 
701 requests of the printer driver 703 printing process- 
ing of data received from the application 701 , the printer 
driver 703 which has received the printing processing 
request uses the rasterizer 703-1 to rasterize a printing 
document as image data, and stores the image data in 
the image memory 710. The image data stored in this 
manner is transferred to the forgery determination 
processing module 703-3 and printing spooler 709 
which start forgery detemninatlon processing and print- 
ing processing, respectively. 

[0082] Similar to the first embodiment, the forgery de- 
temiination processing module 703-3 detennines by 
pattem matching whether an image to be printed con- 
tains a copying-prohibited pattern, and outputs the re- 
sult as a detemninatlon ratio to the anti-forgery control 
module 705. 

[0083] The anti-forgery control module 705 compares 
a threshold set In advance in the OS 702 with the deter- 
mination ratio as an output value from the forgery deter- 
mination processing module 703-3. When the determi- 
nation ratio is higher, anti-forgery control module 705 
executes image processing similar to Figs. 4A and 4B, 
and displays a warning dialogue similar to the one 
shown in Fig. 6 on a monitor 708. 
[0084] Fig. 10 is a graph for explaining the image 
processing principle of the printer system for image data 
to be forged. In Fig. 10, the ordinate represents Yellow 
data at part of an Image, and the abscissa represents 
the main scanning position of the Image. For example, 
when Image data is In a color space fomnat of M (Ma- 
genta), C (Cyan), Y (Yellow), and BK (BlacK), the Image 
data has 256 tone levels from "0" to "255". As image 
data is nearer "255", the Image is dark. 
[0085] In Fig. 10, image data I means original image 
data before processing. By setting Image data to a larger 
value by a given value for all the pixels of the image 
data, processed image data II is generated. Of Image 



data II, all data of "255" or more are "255", so that tonal 
Information of the Image is lost. This processing is exe- 
cuted for Magenta, Cyan, and Black as well as Yellow 
to output image in Fig. 4B. 

[0086] Similar to the first embodiment, the second 
embodiment cannot retum a processed Image to an Im- 
age before processing. From this, an Image displayed 
on the monitor 708 from the application 701 or an Image 
saved in an HDD 706 is also a processed image. 
[0087] When the user determines notto perfomi print- 
ing on the dialogue shown in Fig. 6 (when the button 
BT2 is selected and clicked), a spool stop instruction is 
issued to the spooler 709, and printing processing ends. 
[0088] To the contrary, when the user determines to 
perfomi printing on the dialogue shown In Fig. 6 (when 
the button BT1 is selected and clicked), manipulation 
log Information shown in Fig. 7 is stored in the hard disk 
706 to end printing processing. As a result, when image 
data to be printed is similar to anti-forgery target image 
data, the image to be printed is printed out as a proc- 
essed image, and image data 11 shown in Fig. 10 is not 
output directly. I.e., as an original Image. 
[0089] As described above, according to the second 
embodiment, the Infomriation processing apparatus in 
which the operating system can control printing opera- 
tion of image data by the printer via the printer driver 
compares image data rasterized by the printer driver 
with specific image data to detemiine the matching de- 
gree, controls predetermined image processing for the 
Image data rasterized by the printer driver on the basis 
of the detennination result, and thus even in an environ- 
ment which can perfomn Image output processing by the 
printer itself (not use a scanner), when Image data which 
matches a specific image whose copying operation is 
prohibited is rasterized, processes the rasterized illicit 
image data which matches the specific image into insig- 
nificant image data, thereby reliably preventing image 
output processing of creating a forgery from a copying- 
prohibited original. 

[Third Embodiment] 

[0090] The first and second embodiments have de- 
scribed a case wherein the tint component of image data 
is processed into a tint component different from an orig- 
inal. However, anti-forgery image processing of the 
present invention is not limited to this, and may be mod- 
ified to perfomn processing of thinning input image data 
to decrease the resolution, decreasing the gray levels 
of image data, or replacing image data stored in Image 
data or generated with another image data and raster- 
izing the replaced image data. 
[0091] Alternatively, processing of leaving only one 
color of R, G, and B, or M, C, Y, and BK and erasing 
images of the remaining colors may be executed. These 
processes may be appropriately combined. This em- 
bodiment will be explained. 

[0092] Figs. 11, 12, and 13 are views each showing 
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an example of Image processing In an image processing 
system according to the third embodiment of the present 
invention. In Fig. 11, part of an original image 11-1 is 
enlarged and represented In units of pixels to obtain an 
enlarged main part image 1 1 -2. If pixels to be left In tar- 
get image data 1 2-1 con^espondlng to the enlarged main 
part image 11-2 shown In Fig. 11 are designated with 
arrows, image processing of extracting only information 
of the pixels designated by the arrows is executed to 
generate image data 12-2 to be output, in the example 
shown in Fig. 12, the resolution is decreased by simply 
thinning Infomnation every other pixel. After the resolu- 
tion is decreased, the image data is output as one re- 
duced to 1/2 (50%) the Image data before the resolution 
is decreased. 

[0093] When image data before processing Is made 
up of color signals of R (Red), G (Green), and B (Blue), 
and image data of each color signal is 8-bit data repre- 
senting 256 gray levels from "0" to "265", the resolution 
Is decreased by fixing lower 4 bits to 0 without changing 
upper 4 bits. 

[0094] Fig. 13 Is an image as a result of perfonning 
anti-forgery image processing for original data shown in 
Fig. 4A when another Image is to be added to Image 
data. 

[0095] In the example shown in Fig. 13, image data 
of pixels corresponding to characters "COPY" are add- 
ed to an original image. Note that only one color of R, 
G, and B, or M, C, Y, and BK may be left, and Images 
of the remaining colors may be erased. 
[0096] In this case, for, e.g., R, G, and B, image data 
of Red as one separated color is left without any 
processing, and data of all the pixels are changed to 
"255" for image data of the remaining Green and Blue 
colors. 

[0097] According to the first to third embodiments, for- 
gery operation can be suppressed by the scanner driver 
or printer driver, and thus the forgery suppression effect 
can be expected for all Image Inputs from scanners and 
image outputs to printers. 

[0098] The configuration of a data processing pro- 
gram readable by the infomfiation processing apparatus 
according to the present Invention will be explained with 
reference to a memory map shown in Fig. 14. 
[0099] Fig. 14 Is a view for explaining the memory 
map of a storage medium which stores various data 
processing programs readable by the information 
processing apparatus according to the present inven- 
tion. 

[0100] Although not shown, this storage medium 
sometimes stores information for managing programs 
stored in the storage medium, such as version Informa- 
tion and programmer name, and Information depending 
on the OS of the program reading side, such as an icon 
for discrimi natively displaying a program. 
[0101] Further, data subordinate to various programs 
are also managed by directory infomriation. In some cas- 
es, the storage medium also stores a program for install- 



ing various programs in a computer, or a program for 
decompressing a program to be installed when the pro- 
gram is compressed. 

[0102] The functions shown in Figs. 3 and 8 may be 
5 achieved by the host computer 21 in accordance with 
an externally Installed program. The present Invention 
is also applied to a case wherein pieces of Infomnation 
including a program are supplied to an output apparatus 
from a storage medium such as a CD-ROM, flash mem- 
10 ory, or FD, or from an external storage medium via a 
network. 

[0103] In the first to third embodiments, the anti-for- 
gery control module saves a copying-prohibited pattern 
as a template for image data (scanner driver) input by 

15 the scanner or rasterlzed image data (printer driver), 
and performs pattern matching to detenmine whether 
the image data matches a copying-prohibited image. 
This detemiination is not limited to pattern matching. 
When digital watennarl< information representing a cop- 

20 ying-prohibited image is embedded in the copying-pro- 
hibited image, this digital watermark may be held by the 
anti-forgery control module, and detected from the (in- 
put or rasterized) image data to determine the presence 
of the copying-prohibited image. 

25 [0104] Note that the digital watennaric may be one 
which is embedded in a specific frequency In an image 
and cannot be recognized with a naked eye, or one 
which Is embedded in a copying-prohibited image with 
an un noticeable size and color and can be visually rec- 

30 ognized. The digital watemnartc is preferably embedded 
in the pattern of a copying-prohibited image because the 
digital watermark cannot be visually recognized. 
[0105] The digital watermark may contain, as code in- 
formation, information about the type of copying-prohib- 

35 ited image, the issue country, the issue number, and the 
value. This infonnation may be determined by the for- 
gery detemiination module, and stored as log informa- 
tion as shown In Fig. 7. If the log infonnation is stored 
In the folder of the HDD 108 by encrypting this infomna- 

40 tion so as not to decrypt it without using a dedicated ap- 
plication, the log of processing the copying-prohibited 
image can be stored with high security. 
[0106] When the copying-prohibited image Is proc- 
essed by the anti-forgery control module, the log infor- 
ms matlon shown in Fig. 7 may be added as a digital wa- 
termari< to a processed image. With this processing, 
even if an image is formed using a printer driver having 
no forgery determination module, the added digital wa- 
temnaric can be detected from the print by the scanner 

50 driver. 

[Fourth Embodiment] 

[01 07] A case wherein an Infomnation processing ap- 
55 paratus reads an original by a scanner, and if infomna- 
tion (digital watermari<) which cannot be recognized with 
a naked eye is embedded in the read original, executes 
predetermined image processing will be explained as 
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the fourth embodiment of the present invention. 
[0108] The arrangements of an information process- 
ing apparatus, scanner, and printer in the fourth embod- 
iment are the same as those shown in Fig. 1 , and a de- 
scription thereof will be omitted. 5 
[0109] Fig. 15 is a block diagram showing the ar- 
rangement of an image processing system in the fourth 
embodiment, and shows in detail the Internal structure 
of the operating system (OS) of a host computer 21 . 
Note that most of OSs such as UNIX isolatediy mount a io 
device driver which Interfaces with hardware such as a 
scanner, and various modules for perfomriing manage- 
ment of other user applications, memory management, 
and the like. In this embodiment, an OS having this iso- 
lation structure will be exemplified. 
[0110] As shown in Fig. 1 5, an OS 1 02 has a scanner 
driver 103 as a module for controlling a user input and 
another hardware device, and in addition controlling a 
scanner 104. The scanner driver 103 in the fourth em- 
bodiment comprises a scanner control module 1 03-1 for 20 
directly controlling the scanner 1 04 and a digital water- 
mark extraction module 103-3 for extracting information 
(digital watemaark) embedded in image data from the 
image data read by the scanner 104. 
[0111] The OS 102 comprises an image processing 25 
control module 1 1 6 for executing image processing con- 
trol processing (to be described in detail later) in accord- 
ance with the extraction result from the digital watermark 
extraction module 103-3, and a display driver 107 for 
displaying image data read by the scanner 104, a user 30 
interface window, or the like on a monitor 109. 
[01 12] Further, the OS 1 02 comprises a memory man- 
agement module 1 05 for managing an image data area 
as an image memory 110 (part of a RAM 205) 
[0113] A scanner manipulation application (applica- 35 
tion) 1 01 is made up of a GUI routine for interfacing with 
the user, a routine for interpreting a user input received 
via the OS 1 02 and issuing an instruction for operating 
the scanner 104, a routine for displaying image data 
read from the scanner 104, and a routine for saving read ^^o 
image data In an HDD 108. 

[01 14] The scanner 1 04 sends, to the host computer 
21 in accordance with a predetennined interface rule, 
image data obtained by scanning an original placed on 
a table with a CCD line sensor (not shown) in accord- -^5 
ance with a scanner manipulation command (signal) 
from the scanner driver 103, optically reading the origi- 
nal, and converting the image data into an electrical sig- 
nal (photoelectric conversion). 

[0115] The image signal is comprised of luminance 50 
signals of color components, e.g., R, G, and B, and each 
luminance signal is multilevel data of 8 to 12 bits. 
[0116] An operation of reading an original by the scan- 
ner 104, and if information (digital watemiartc) which 
cannot be recognized with a naked eye is embedded in 55 
the read original, executing predetemiined image 
processing will be explained. 
[0117] Fig. 1 6 is a flow chart showing an example of 



the processing sequence of the system in the fourth em- 
bodiment. This processing corresponds to data 
processing between the modules of the application 1 01 , 
OS 1 02, and scanner driver 1 03 shown in Fig. 15. S401 
to S403 shown in Fig. 1 6 correspond to the steps of the 
application 1 01 ; S41 1 to S41 5, to the steps of the oper- 
ating system 1 02; and S421 to S424, to the steps of the 
scanner driver 1 03. 

[0118] When the user instructs scanning start opera- 
tion via the GUI of the application 101 , the application 
101 advances to step S401. Before read operation 
starts, the application 1 01 ensures in the image memory 
110 (RAM 205) the area of an image to be read that is 
designated by the user. Note that the image area on the 
image memory 110 is ensured by the memory manage- 
ment module 105. In step S402, the application 101 
specrfies the scanner 1 04 to the OS 1 02, issues an im- 
age read instnjction, and enters a wait state and stays 
there until the application 101 receives an image read 
processing end notification in step S403. 
[01 1 9] In step S41 1 , the OS 1 02 which has received 
the scanning start instruction invokes the scanner con- 
trol module 1 03-1 of the scanner driver 1 03 correspond- 
ing to the specified scanner (in the fourth embodiment, 
the scanner 1 04) to issue an image read instruction with 
the scanner 104. The OS 102 enters a wait state and 
stays there until processing of the scanner driver 103 
ends. At this time, the OS 102 prepares a variable for 
information extracted from a digital watemiark in image 
data output from the digital watemiark extraction mod- 
ule 103-3. 

[0120] In step S421, the scanner control module 
103-1 in the scanner driver 103 that has received the 
scanning start instruction from the OS 102 issues a 
scanning start instruction unique to the scanner to the 
scanner 1 04 to read an image. In step S422, after image 
data of the original Is read, the scanner control module 
1 03-1 stores image data received from the scanner 1 04 
in the ensured image data area of the application 101 
in the image memory 110 (RAM 205), and shifts 
processing to the digital watermark extraction module 
103-3. 

[01 21 ] Digital watemriaric extraction processing in the 
digital watemnark extraction module 103-3 will be ex- 
plained. 

[01 22] The digital watermark extraction module 1 03-3 
divides the input image data into blocks, and performs 
Fourier transfonnation for each block to extract a fre- 
quency component. The digital watemiark extraction 
module 1 03-3 separates image data of the obtained fre- 
quency area into an amplitude spectrum and phase 
spectrum, and detects a registration signal contained in 
the amplitude spectrum. 

[0123] The registration signal is embedded by an im- 
pulse signal to a frequency of an intemnediate level 
which is equal to or lower than the first frequency level 
at which the registration signal is hardly recognized by 
the human perception, and equal to or higher than the 
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second frequency at which the registration signal is not 
removed by irreversible compression/decompression, 
In consideration of the drawbacks of a high-frequency 
component and low-frequency component that embed- 
ding of a signal in a low-frequency component is readily 5 
recognized as noise by the visual characteristic of the 
human, as compared to embedding of a signal in a high- 
frequency component, and that an Irreversible compres- 
sion method such as JPEG compression has a low-pass 
filter effect and the high-frequency component is re- 
moved by compression/decompression processing. 
[0124] In registration detection, the digital watermark 
extraction module 103-3 extracts the impulse signal in 
the intermediate-level frequency range included in the 
amplitude spectrum. The digital watennark extraction 
module 1 03-3 calculates the scaling factor of digital Im- 
age data from the coordinates of the extracted Impulse 
signal. The digital watennark extraction module 1 03-3 
detects in advance which frequency component of an 
image to be detected before scaling contains an impulse 
signal. 

[01 25] The digital watermark extraction module 1 03-3 
can calculate the scaling factor from the ratio of the fre- 
quency detected in advance to the frequency at which 
the impulse is detected. Letting a be the frequency de- 
tected in advance, and b be the frequency at which the 
impulse is detected, scaling at a/b Is perfonrted. This is 
the property of known Fourier transfomnatlon. 
[01 26] The digital watermark extraction module 1 03-3 
determines the size of a pattem for detecting a digital 
watermark contained in digital image data, and performs 
convolution using the pattern to detect the digital water- 
mark contained in the digital Image data. 
[01 27] Note that the digital watermark may be added 
to any component constituting digital image data. In 
general, however, the digital watermark is added to a 
blue component to which the human visual sense is 
most Insensitive. In this case, the above-described pat- 
tern detection is done for a blue component. 
[0128] When a digital watennark is not added to a vis- 
ible color component constituting digital Image data, but 
a digital watennark for embedding information in a spe- 
cific frequency component is embedded in digital image 
data, processing may be done to detect the digital wa- 
tennark for the specific frequency after the digital Image 
data undergoes Fourier transformation. 
[0129] The digital watennark may be one which is em- 
bedded in a specific frequency In an image and c-annot 
be recognized with a naked eye, or one which is embed- 
ded in an image with an unnoticeable size and color and 
can be visually recognized. The digital watermark is 
preferably embedded in the pattern of an image be- 
cause the digital watermark cannot be visually recog- 
nized. 

[01 30] The digital watemnark may contain, as code in- 
fonnation, information aboutthetype of image, the issue 
country, the Issue number, and the value. This informa- 
tion may also be determined by the digital watennark 



extraction module, and stored as log information as 
shown in Fig. 7. If the log information is stored in the 
folder of the HDD 1 08 by encrypting this infonnation so 
as not to decrypt It without using a dedicated application, 
the log of processing the digital watermark-embedded 
image can be stored with high security. 
[0131] When the digital watermark-embedded image 
is processed by the digital watennark extraction module, 
the log Infonnation shown in Fig. 7 may be added as a 
digital watennark to a processed Image. With this 
processing, even if an image Is formed using a printer 
driver having no digital watennark extraction module, 
the added digital watennark can be detected from the 
print by the scanner driver. 

[0132] The fourth embodiment has described the dig- 
ital watennark extraction module 1 03-3 as a software 
module. However, the digital watermark extraction mod- 
ule 1 03-3 can be realized by perfonning processing by 
hardware constituted by, e.g., a high-speed RISC and 
ASIC to increase the speed. 

[0133] After the Image data is read and subjected to 

digital watennark extraction processing, the scanner 
driver 103 notifies in step 8424 the OS 102 of the end 
of read processing, and at the same time returns the 
result representing whether information can be extract- 
ed, and extracted infonnation. 
[01 34] if the OS 1 02 receives the processing end no- 
tlfteatlon from the scanner driver 103 in step S412, the 
OS 1 02 checks In step S41 3 whether a digital watermark 
is extracted. If the digital watennark is extracted, the OS 
102 advances to step S414, and shifts to image 
processing (to be described in detail later). 
[01 35] If the digital watennari( Is not extracted In step 
8413, and image processing ends, the OS 102 issues 
a processing end notification to the application 101. 
When the application 1 01 receives the processing end 
notification in step S403, Image read operation of the 
scanner system ends. 

[01 36] Details of image processing control processing 
(8414 shown In Fig. 16) perfomried by the Image 
processing control module 116 will be described. 
[01 37] Fig. 1 7 is a view showing an example of a user 
interface window displayed on the monitor 1 09. This ex- 
ample shows a window displayed to the user when dig- 
ital watermark information is recognized to exist In Im- 
age data read by the scanner 1 04. 
[0138] In Fig. 17, reference numeral 401 denotes a 
button whbh is selected and clicked by the user when 
the user approves the contents of a display and outputs 
extracted infonnation by overiaying it on an Image. Figs. 
1 8A and 1 8B show an example of the image output at 
this time. Fig. 1 8A is an original image read by the scan- 
ner 1 04, and Fig. 1 8B is a result of overlaying extracted 
infonnation on Fig. 18A. 

[01 39] Reference numeral 402 in Fig. 1 7 denote a but- 
ton which is selected by the user when the user ap- 
proves the contents of a display and does not overlay 
the extracted infonnation on the Image output. 
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[0140] Fig. 19 is a view showing an example of log 
information stored in the hard disl^ 108. This example 
shows information extracted from a digital watemnarlc. 

[Fifth Embodiment] 

[0141] The fourth embodiment has described a case 
wherein a digital watermark is extracted from an input 
image to execute predetermined image processing in a 
scanner system. The same processing can also be per- 
fonned in a printer system. A system In the fifth embod- 
iment will be explained. 

[01 42] The arrangement of the system in the fifth em- 
bodiment is the same as that shown in Fig. 1 , and a de- 
scription thereof will be omitted. 
[0143] Fig. 20 is a block diagram showing the ar- 
rangement of an image processing apparatus in the fifth 
embodiment. According to the fifth embodiment, image 
processing Is done by a printer driver 703 and OS 702 
in the image processing system built by a host computer 
21 and printer. Similar to the fourth embodiment, the OS 
702 runs on the host computer 21 , and an application 
701 running on the OS 702 provides a manipulation en- 
vironment for image output operation to a printer 704. 
[0144] Simllarto the scanner system shown in Fig. 15, 
the printer system shown in Fig. 20 is also implemented 
on a hardware arrangement shown In Fig. 1 . This sys- 
tem is built by the host computer 21 and printer 704. 
Both the OS 702 and application 701 on the host com- 
puter 21 realize image processing in the information 
processing apparatus by running by a CPU 204 a pro- 
gram loaded from an HDD 1 08 to a RAM 205. 
[01 45] As shown in Fig. 20, the OS 702 has the printer 
driver 703 as a module for controlling a user input and 
another hardware device, and in addition controlling the 
printer 704. The printer driver 703 In the fifth-embodi- 
ment comprises a rasterizer 703-1 for generating Image 
data suitable for the printer 704, a memory management 
module 703-2 for managing an image memory 710 for 
storing the generated image data, and a digital water- 
maric extraction module 703-4 for extracting and 
processing infonnation by a digital watemnark in the ras- 
terized image data. 

[0146] The OS 702 comprises an image processing 
control module 71 5 for executing image processing con- 
trol processing (to be described in detail later) for an ex- 
traction result from the digital watermark extraction 
module 703-4, and a display driver 707 for displaying 
an output document, user Interface window, and the like 
on a monitor 708. The extraction result as an output from 
the digital watemnark extraction module 703-4 is trans- 
ferred to the image processing control module 715, 
whk;h perfomis processing of an image in accordance 
with the extraction result. 

[0147] The OS 702 has a printing spooler (spooler) 
709 for perfomiing control for outputting a rasterized im- 
age to the printer 704. 

[0148] Note that the rasterizer 703-1 , image memory 



710, and digital watennark extraction module 703-4 are 
adopted as the printer driver 703 and operated by soft- 
ware processing, but may be operated on the printer 704 
side. In this case, the result of digital watennark extrac- 

5 tion done by the printer 704 is returned to the image 
processing control module 715. 
[0149] An operation of extracting infonnation embed- 
ded by a digital watennark in image data to be output 
from the host computer 21 to the printer 704, and exe- 

10 cuting image processing control processing will be de- 
scribed. 

[0150] Fig. 21 is a flow chart showing the processing 
sequence of the system in the fifth embodiment. This 
processing corresponds to data processing between the 

IS modules of the application 701 , OS 1 02, and printer driv- 
er 703 shown in Fig. 20. S801 and S802 shown In Fig. 
21 correspond to the steps of the application 701 ; S811 
to S815, to the steps of the operating system 702; and 
S821 to S824. to the steps of the printer driver 703. 

20 [01 51 ] When the user designates a desired document 
and printer via the application 701 and instructs the start 
of printing processing, a printing instruction command 
is sent to the OS 702. Then, the application 701 enters 
a wait state and stays there until the application 701 re- 

25 ceives a printing processing end notification In step 
S802. 

[0152] In step S81 1 , the OS 1 02 which has received 
the printing instruction command requests printing 
processing of a document received from the application 

3(? 701 , of the printer driver 703 corresponding to the des- 
ignated printer (in the fifth embodiment, the printer 704), 
and enters a wait state and stays there until processing 
of the printer driver 703 ends. At this time, the OS 702 
prepares a variable for information extracted from a dlg- 

35 ital watennaric in image data output from the digital wa- 
termart< extraction module 703-4. 
[0153] The rasterizer 703-1 in the printer driver 703 
which has received the printing processing request from 
the OS 702 rasterizes a printing document as image da- 

40 ta, and stores the image data in the image memory 71 0. 
In step S822, the digital watennark extraction module 
703-4 extracts infonnation embedded by a digital water- 
mark from the image data stored in the image memory 
710. 

45 [01 54] At the same time when the image data Is trans- 
ferred to the digital watennark extraction module 703-4, 
it is also transferred to the spooler 709, and the printer 
704 starts printing processing in step S823. 
[0155] After extraction and printing processing of in- 

so fonnation embedded by the digital watermartc in the Inn- 
age data end, the printer driver 703 notifies the OS 702 
of the end of printing processing in step S824, and at 
the same time returns the digital watermaric extraction 
result and extracted information. 

55 [01 56] The OS 702 receives the processing end noti- 
fication of the printer driver 703 in step S81 2, and checks 
in step S813 whether a digital watermaric is extracted. 
If the digital watermari< is extracted, the OS 702 shifts 



12 



EP 1 102 466 



Pa ge 13 of 38 



23 



EP 1 102 466 A2 



to image processing in step S814, and executes the 
same processing as that in the fourth embodiment. 
[01 57] After this processing ends, the OS 702 outputs 
a processing end notification to the application 701 . If 
the application 701 receives the processing end notifi- 
cation in step S802, printing processing of this system 
ends. 

[0158] The configuration of a data processing pro- 
gram readable by the infonnation processing apparatus 
according to the present invention will be explained with 
reference to a memory map shown in Fig. 22. 
[0159] Fig. 22 Is a view for explaining a memory map 
to a storage medium which stores various data process- 
ing programs readable by the infonnation processing 
apparatus according to the present invention. 
[0180] Although not shown, this storage medium may 
store information for managing modules stored in the 
storage medium, such as version Infonnation and pro- 
grammer name, and Infonnation depending on the OS 
of the program reading side, such as an Icon for discrim- 
inativeiy displaying a program. 
[0161] Further, data subordinate to various programs 
are also managed by directory infonnation. In some cas- 
es, the storage medium also stores a program for install- 
ing various programs In a computer, or a program for 
decompressing a program to be installed when the pro- 
gram Is compressed. 

[0162] The functions shown in Figs. 16 and 21 may 
be achieved by the host computer in accordance with 
an externally installed program. The present Invention 
is also applied to a case wherein pieces of Infonnation 
including a program is supplied to an output apparatus 
from a storage medium such as a CD-ROM, flash mem- 
ory, or FD, or from an external storage medium via a 
network. 

[0163] The objects of the present Invention are also 
achieved by supplying a storage medium which records 
a program code of software that Implements the func- 
tions of the above embodiments to a system or appara- 
tus, and reading out and executing the program code 
stored in the storage medium by the computer (CPU or 
MPU) of the system or apparatus. 
[0164] In this case, the program code read out from 
the storage medium Implements the functions of the 
above embodiments, and the storage medium which 
stores the program code constitutes the present inven- 
tion. 

[0165] As the storage medium for supplying the pro- 
gram code, for example, a floppy disk, hard disk, optical 
disk, magneto-optical disk, CD-ROM, CD-R, magnetic 
tape, nonvolatile memory card, ROM, and the like can 

be used. 

[0166] The functions of the above embodiments may 
be implemented not only by executing the readout pro- 
gram code by the computer but also by perfonning some 
or all of actual processes by an OS (Operating System) 
running on the computer on the basis of an instruction 
of the program code. 
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[0167] Furthermore, the present invention also in- 
cludes a case wherein the program code read out from 
the storage medium is written In the memory of a func- 
tion expansion board inserted into the computer or a 
5 function expansion unit connected to the computer, the 
CPU or the like of the function expansion board or func- 
tion expansion unit perfomris some or all of actual proc- 
esses in accordance with the instruction of the program 
code, and the functions of the above embodiments are 
realized by this processing. 

[0168] As has been described above, according to 
these embodiments, embedded infonnation can be out- 
put as visible infonnation by extracting the information 
embedded in the image, processing the extracted infor- 
mation Into an image, and outputting the Image. 
[0169] As many apparently widely different embodi- 
ments of the present invention can be made without de- 
parting from the spirit and scope thereof, it is to be un- 
derstood that the invention is not limited to the specific 
embodiments thereof except as defined In the append- 
ed claims. 



1. An infonnation processing apparatus capable of 
controlling read operation of an original image by a 
scanner via a scanner driver, characterized by com- 
prising: 

30 

detennlnatlon means (103-2) for detemninlng . 
by the scan ner driver whether digital watermari< 
Information Is embedded in Image data read by 
the scanner; and 
35 control means (106) for controlling predeter- 

mined image processing for the read Image da- 
ta on the basis of a determination result by said 
detemnination means. 

40 2. The apparatus according to claim 1 , wherein said 
control means processes the read image data into 
image data different from the read image data when 
said detemnination means determines that the read 
Image data substantially matches the specific im- 

45 age data. 

3. The apparatus according to claim 1, further com- 
prising display means (1 09) for displaying a warning 
message representing that the Image data Is proc- 

50 essed to match the specific Image data when the 

predetenntned image processing Is perfomned for 

the read Image data, 

wherein said control means discards the read 

and processed Image data on the basis of an image 
55 processing request from a user in response to the 

warning message displayed on said display means. 

4. The apparatus according to claim 3, wherein said 
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control means creates log infomnatlon from which a 
read processing status of the specific image data 
can be verified, and registers the log information in 
a nonvolatile memory on the basis of the Image 
processing request from the user in response to the 5 
warning message displayed on said display means. 

5. The apparatus according to claim 1 , wherein the 
predetemnined Image processing includes resolu- 
tion conversion processing of converting a resolu- io 
tion of the read image data, color conversion 
processing of converting color tone of the read im- 
age data, and Image conversion processing of add- 
ing arbitrary Image data to the read image data. 

15 

6. The apparatus according to claim 1 , wherein the 
specific image data is data of an original image 
whose copying operation is prohibited by law. 

7. The apparatus according to claim 1 , wherein the 
specific image data is stored and managed in ad- 
vance so as to be updateable. 

8. The apparatus according to claim 1 , wherein the 
scanner can be connected via a local Interface or a 25 
network Interface. 

9. The apparatus according to claim 1 , wherein the 
digital watennark information is embedded in the 
specific image data at a predetemnined cycle. 30 

10. The apparatus according to claim 1, wherein the 
digital watennark Infomnatlon Includes, as code in- 
formation, information about the type of specific im- 
age data, an Issue country, an issue number, and a ^ 
value. 

11. The apparatus according to claim 1, wherein the 
digital watermark infonnation includes invisible or 
visible infonnation. 40 

12. The apparatus according to claim 1, further com- 
prising storage means (1 1 0) for storing image data 
read by the scanner, 

wherein said control means also processes 45 
an image stored in said storage means. 

13. An Image processing method for an infomnatlon 
processing apparatus capable of controlling read 
operation of an original Image by a scanner via a so 
scanner driver, characterized by comprising: 



ta on the basis of a determination result in the 
detenninatlon step. 

1 4. The method according to claim 1 3, wherein the con- 
trol step comprises processing the read image data 
Into image data different from the read image data 
when the image data is detemiined in the determi- 
nation step to substantially match the specific Im- 
age data. 

15. The method according to claim 13, further cohnprls- 
Ing a display step (S602) of displaying a warning 
message representing that the image data Is proc- 
essed to match the specific image data when the 
predetemnined Image processing is perfonned for 
the image data in the control step, 

wherein the control step comprises discarding 
the read and processed image data on the basis of 
an image processing request from a user In re- 
sponse to the warning message displayed in the 
display step. 

1 6. The method according to claim 1 3, wherein the pre- 
determined image processing includes resolution 
conversion processing of converting a resolution of 
the read Image data, color conversion processing 
of converting color tone of the read Image data, and 
Image conversion processing of adding ariDltrary 
image data to the read image data. 

1 7. The method according to claim 1 3, wherein the con- 
trol step comprises creating tog Information from 
which a read processing status of the specific Image 
data can be verified, and registering the log infor- 
mation in a nonvolatile memory on the basis of the 
Image processing request from the user in re- 
sponse to the warning message displayed In the 
display step. 

18. The method according to claim 13, wherein the spe- 
cific Image data is data of an original image whose 
copying operation Is prohibited by law. 

1 9. The method according to claim 1 3, wherein the spe- 
cific image data Is stored and managed in advance 
so as to be updateable. 

20. A computer-readable storage medium which stores 
a program for causing an infonnation processing 
apparatus capable of controlling read operation of 
an original image by a scanner via a scanner driver, 
to execute 

a determination step of determining by the 
scanner driver whether digital watemnari< infor- 
mation is embedded in image data read by the 
scanner, and 

a control step of controlling predetemnined im- 



a detemnrnation step (S323) of detenmining by 
thescannerdrlverwhetherdigltalwatemnaric In- 
fonnation is embedded In image data read by 55 
the scanner; and 

a control step (S314) of controlling predeter- 
mined image processing for the read image da- 
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age processing for the read image data on the 
basis of a detemnination result in the detenmi- 
nation step. 

21. The medium according to claim 20, wherein the 
control step comprises processing the read image 
data into image data different from the read image 
data when the Image data is detemilned in the de- 
tenminatlon step to substantially match the specific 
image data. 

22. The medium according to claim 20, wherein 

the computer-readable storage medium 
records a program for causing the infonnation 
processing apparatus to execute the display 
step of displaying a warning message repre- 
senting that the image data is processed to 
match the specific image data when the prede- 
termined image processing is performed for the 
image data in the control step, and 
the control step comprises discarding the read 
and processed image data on the basis of an 
Image processing request from a user in re- 
sponse to the warning message displayed in 
the display step. 



prising selection means (1 09) for causing a user to 
select whether to process the image data by said 
image processing means. 

5 27. The apparatus according to claim 26, wherein said 
selection means displays whether to process the 
image data on display means, thereby causing the 
user to select whether to process the image data. 

10 28. The apparatus according to claim 25, wherein said 
image processing means overiays the infonnation 
extracted by said Information extraction means on 
the image data. 

15 29. A processing method for an infonnation processing 
apparatus capable of controlling read operation of 

an original image by a scanner via a scanner driver, 
characterized by comprising: 

20 an infonnation extraction step {S423) of ex- 

tracting, by the scanner driver, digital water- 
mark infomnation embedded in image data read 
by the scanner; and 

an Image processing step (S413) of processing 
25 the image data on the basis of an extraction re- 

sult in the infonnation extraction step. 



23. The medium according to claim 22, wherein the 
control step comprises creating log information 
from which a read processing status of the specific 
image data can be verified, and registering the log 
Infonnation in a nonvolatile memory on the basis of 
the Image processing request from the user with re- 
spect to the warning message displayed in the dis- 
play step. 

24. The medium according to claim 20, wherein the pre- 
determined Image processing includes resolution 
conversion processing of converting a resolution of 
the read image data, color conversion processing 
of converting color tone of the read image data, and 
image conversion processing of adding arisitrary 
image data to the read image data. 

25. An infomnation processing apparatus capable of 
controlling read operation of an original image by a 
scanner via a scanner driver, characterized by com- 
prising: 

Infonnation extraction means (103-3) for ex- 
tracting, by the scanner driver, digital water- 
mark infonnation embedded in image data read 
by the scanner; and 

image processing means (116) for processing 
the image data on the basis of an extraction re- 
sult from said infonnation extraction means. 

26. The apparatus according to claim 25, further com- 



30. A computer-readable storage medium which stores 
a program for causing an infomnation processing 

30 apparatus capable of controlling read operation of 
an original image by a scanner via a scanner driver, 
to execute 

an information extraction step of extracting, by 
55 the scanner driver, digital watemnark infonna- 

tion embedded in image data read by the scan- 
nen and 

an image processing step of processing the in- 
put Image data on the basis of an extraction re- 
40 suit. 

31. A method of perfomning processing in an operating 
system and a scanner driver to control an image 
read operation by a scanner to prevent the gener- 

45 atlon of Image data faithfully representing a copy- 
prohibited image, comprising: 

determining whether image data representing 
an Image read by the scanner has predeter- 
50 mined characteristics indicating that the image 

is copy-prohibited; and 

processing the Image data if it is determined 
that the image is copy-prohibited so that the im- 
age data does not faithfully represent the im- 
55 age. 

32. An operating system for a computer processing ap- 
paratus having processor-implementable instruc- 
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tions for causing the apparatus to perform at least 
one on the processing operations of: 

detemiining whether innage data representing 

an image read by a scanner has predetermined s 
characteristics Indicating that the image is 
copy-prohibited; and 

processing image data representing an image 
read by the scanner if instructions are received 
indicating that the Image is copy-prohibited so *o 
that the image data does notfaithfuily represent 
the image. 

33. A printer driver for a computer processing appara- 
tus comprising at least one of: 

means for determining whether image data rep- 
resenting an image read by a scanner has pre- 
determined characteristics indicating that the 
image is copy-prohibited; and 
means for processing image data representing 
an Image read by the scanner If instructions are 
received indicating that the image is copy-pro- 
hibited so that the Image data does notfaithfuily 
represent the Image. 

34. A signal conveying instructions for causing a pro- 
grammable processing apparatus to become oper- 
able to perform processing to cany out a method as 

set out in at least one of claims 13 to 1 9, 29 and 31 . 30 
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FIG. 3 
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FIG. 6 
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FIG. 7 
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FIG. 14 
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FIG. 16 
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FIG. 17 
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